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Digital Signal Processing Methods and Apparatus 

This invention generally relates to methods, apparatus and computer program code 
processing digital data using non-negative matrix factorisation; embodiments of the 
invention are particularly applicable to multi-line addressing (MLA) techniques for 
displays such as passive-matrix OLED (organic light emitting diode) displays. 

Techniques for feature analysis (decomposing data to weighted sets of features) include 
vector quantisation (VQ), principle components analysis (PCA) and non-negative 
matrix factorisation (NMF). Broadly speaking vector quantisation aims to identify a set 
of prototypical features which can be used to represent data by identifying the 
prototypical feature from the set to which it most closely corresponds. Principle 
components analysis aims to construct a set of orthogonal basis functions which can 
then be combined to represent the data. Vector quantisation is inappropriate for many 
applications as it does not attempt to exactly reproduce data, rather it finds the closest 
match from the set of prototypical features. Principal component analysis, and other 
techniques such as singular value decomposition (S VD) suffer from the disadvantage 
that the prototypical or basis functions can be negative and thus tend to lack any 
physical reality. By contrast non-negative matrix factorisation is a technique in which a 
target matrix is decomposed into a pair of factor matrices which when multiplied 
together approximate the target, under the constraint that negative entries in the factor 
matrices are not permitted. Because of this the features and their weights tend to 
correspond to practically useful and recognisable elements. For example the application 
of these three techniques to decomposing images of faces is contrasted in "Learning the 
Parts of Objects by Non-Negative Matrix Factorisation", D.D. Lee and H.S. Seung, 
Nature, Vol 401, 21 st October 1999, pages 788 - 791. 

Non-negative matrix factorisation has further advantages in that the procedure is 
relatively simple, however implementation of the procedure using technical means such 
as digital signal processing hardware is hampered because the procedure is iterative and 
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can be very slow to converge for large datasets. It is therefore inappropriate for many 
practical applications, particularly those which require calculation in real time. So 
called "diagonalised" NMF techniques restrict to a diagonally biased solution (row 
driving scheme) which results in faster convergence but provides little benefit in the 
context of a multi-line addressing scheme. 

We have previously described, in UK Patent Application No. 0421712.1, filed 30 th 
September 2004, how non-negative matrix factorisation techniques may be employed to 
provide improved multi-line addressing for displays, in particular OLED displays. 
Other related background material can be found in UK Patent Applications Nos. 
042171 1.3 and 0421710.5, both filed 30 th September 2004. The contents of all three of 
these applications are hereby incorporated in their entirety by reference. 

To facilitate the application of NMF techniques to multi-line addressing improved 
digital signal processing techniques for NMF are desirable. We will describe such 
techniques with specific reference to their application to OLED display driving; 
however it will be appreciated that the techniques are not limited to such applications. 

According to a first aspect of the invention there is therefore provided a method of 
digitally processing data in a data array defining a target matrix (X) using non-negative 
matrix factorisation to determine a pair of matrices (F, G), a first matrix of said pair 
determining a set of features for representing said data, a second matrix of said pair 
determining weights of said features, such that a product of said first and second 
matrices approximates said target matrix, the method comprising: inputting said target 
matrix data (X); selecting a row of said one of said first and second matrices and a 
column of the other of said first and second matrices; determining a target contribution 
(R) of said selected row and column to said target matrix; determining, subject to a non- 
negativity constraint, updated values for said selected row and column from said target 
contribution; and repeating said selecting and determining for the other rows and 
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columns of said first and second matrices until all said rows and columns have been 
updated. 
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Broadly speaking in embodiments by updating values of the first and second matrix 
row-column by row-column simplified signal processing can be employed. The target 
contribution of each selected row and column is, broadly speaking, the difference 
between the target matrix and the combination of weighted features determined from the 
product of all the other rows and columns of the pair of matrices (and thus the target 
contribution is a matrix of the same size as the target matrix). In other words the target 
contribution is the sum of the weighted features for all the features except the feature 
(and weight) defined by the selected row and column. It will be appreciated that it is 
immaterial which matrix is labelled the first matrix and which the second matrix; 
however at the completion of one cycle of the method all the elements of both the 
matrices (that is, each column of one and each row of the other) have preferably been 
updated. 

In embodiments the data exists in a number of sets, and the target comprises data from 
each set on one or more axes, and properties of the data (for example a set of types, 
classification or reduced parameter analysis) on another axis. In embodiments the 
properties are additive so that a sum of a component or property across multiple sets is 
meaningful. 

Preferably the data in the data array represents a physical entity; it may be provided on a 
data carrier such as an optical or electrical signal carrier, or on any type of volatile or 
non-volatile storage medium. Some examples of this data are given below (the list is 
non-exhaustive): 

1 . Face or other image matching/recognition - the data is image data, the features 
comprising parts of the target, for example parts of images of faces, comprising, for 
example, a set of column vectors each carrying data for a two-dimensional image. This 
is described further in, for example, "Fisher Non-Negative Matrix Factorisation for 
Learning Local Features", Y.Wang, Y.Jia, C.Hu and M. Turk; "Face Recognition with 
Non-Negative Matrix Factorisation", M. Rajapakase and L. Wyse, Prock. SPIE Vol 
5150, pages 1838 - 1847, Visual Communications and Image Processing 2003, T. 
Ebrahimi and T. Sikora (Editors). 



4 

2. Network security - the data comprises, for example, user activity data (or user 
profile data). For example a semantic representation of a user's profile may be 
constructed by means of content - based text filtering (see, for example, "A NMF-based 
Method for Constructing User Profile", H. Gangshi, Z. Yafei, LJianjiang and X. Jiang, 
Journal of the China Society for Scientific and Technical Information, Vol 23, No 4, 
Aug 2004. The network may comprise any type of data network including (but not 
limited to) wired and wireless networks, telecommunications networks, computer data 
networks and other types of networks. The extracted features may comprise, for 
example, typical activity patterns and/or be classified into potentially fraudulent and 
non-fraudulent patterns of activity. 

3 . Data mining - the data comprises stored data in a database and/or multivariate 
data, embodiments of the method being used, for example, to provide a reduced 
representation of the input data by, say, creating a user-defined number of features. 
Broadly speaking data in a database is mapped by an NMF procedure onto a set of 
attributes or features discovered by the procedure. In this way, for example, 
unstructural text data may be mined by factorising a document-term matrix. In this way 
a form of latent semantic analysis may be performed, for example by comparing vectors 
for two (preferably adjoining) segments of text in a high-dimensional semantic space to 
characterise a degree of semantic relatedness between the segments. For example, 
feature extraction can be used to extract the themes of a document collection, where 
documents are represented by a set of key words and their frequencies. Each theme 
(feature) is represented by a combination of keywords. The documents in the collection 
can then be expressed in terms of the discovered themes. It will be appreciated that 
positive values may represent, for example an average frequency of a term (or group of 
terms) across a set of documents; a factor analysis method which gave negative results 
would not be meaningful. 

4. Sensor data processing - the data comprises sensor data such as chemometric 
data, hyperspectral or other spectroscopic/imaging data, surface plasmon resonance 
data, excitation - emission matrix spectroscopy data, optical derivative spectroscopy 
data and the like (see, for example, "Recent Advancements in Chemometrics for 
SMART Sensors", F. Vogt, B. Dable, J. Cramer and K. Booksh, Analyst, 2004, Vol 
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129, pages 492 - 502, and references therein to iterative multivariate curve resolution 
using ALS, alternating leased squares; see also " Feature Extraction of MERIS Data", 
V. Tsagarigs and V. Anastassopoulos, Esanvat Symposium VI - 10 th September 2004, 
Saltzburg, Austria, Poster Session 2P13"). The features may then comprise physically 
meaningful components of the spectra, for example contributions of components to a 
spectrum (and/or of an image). 

5. Biological sequence analysis - data comprises biological sequence data such as 
gene, proteome, nucleotide, or amino acid sequence data, or microarray data, for 
example for matching features (portions of sequences) between different fragments of a 
sequence and/or between portions of data corresponding to localised features in 
expression space (see, for example, "Subsystem Identification though Dimensionality 
Reduction of Large-Scale Gene Expression Data", P.M. Kim and B. Tidor, Genome 
Research, Vol 13, pages 1706 - 1718, 2003). Alternatively, the data may comprise 
other biological data such as atomic coordinate data, for example for ligand- receptor 
binding or interaction site identification. 

6. Machine learning/recognition techniques - data comprises data describing 
objects or parts of objects to be recognised (objects here may be tangible, or intangible 
data objects), such as image data, sound data, text/word data (for analysis) or the like 
(see, for example, "Non-negative Matrix Factorisation on a Possible Way to Learn 
Sound Dictionaries", H.Asari, Watson School of Biological Sciences, Bold Spring 
Harbor Laboratory, 15 th April 2004 ( http://zadorlab.cshl.edu/asari/nmf.html) . The 
number of attributes or dimensions of the original data is preferably reduced by the 
NMF procedure, thus facilitating learning. 

7. Data analysis/pattern recognition - the data comprises the data for analysis, for 
example a list of document references for search result cluster analysis and/or web 
searching (see, for example, "Dimensionality Reduction Techniques for Search Results 
Clustering", S.Osinski, MSC in Advanced Software Engineering, Department of 
Computer Science, University of Sheffield, UK, 20 th August 2004), or word alignment 
data for performing or verifying machine translation (see, for example, "Aligning 
Words using Matrix Factorisation", C. Goutte, K. Yamada and E. Gaussier, 
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http://acl.ldc.upenn.edu/ac 1 2004/main/pdf7 1 87_pdf 2-col.pdf ). This may be used to 
reduce the data not to search through, for example, by selecting based upon features 
prior to searching. The feature-based selecting (pre-filtering) may comprise selecting 
documents based on a set of classifications to, say, identify all documents relating to a 
particular topic, geographical region or the like. Here (as elsewhere in this 
specification) documents may include multimedia material and the like. 

Other classification-type applications include classification of personal data, for 
example, buying habits, responses to questionnaires (e.g. consumer surveys, census 
data, psychometric questionnaires), financial activities - spotting fraud (for example, 
data on benefit claimants), and the like. 

To expand on specific examples, a supermarket may use embodiments of the method to 
predict a minimum number of classifications which describe the buying habits of their 
customers based on loyalty card data. This can be used to target promotions and/or 
other marketing activities at specific groups. Responses to questionnaires could be 
similarly analysed, for example producing a minimum subset which accurately 
reproduces the majority of a group's responses. These classifications may then be 
examined to investigate patterns in attitudes or behaviours. Also, as previously 
mentioned patterns of behaviour, if individual occurrences can be quantified (for 
example benefit claims), can be classified and, potentially, aid the identification of 
possible fraud. 

The techniques described herein may be used on a representative (e.g. pseudo-random) 
selection of data sets or documents to determine a set of features, and then applied to a 
large group of data, for increased speed. 

Applications of feature extraction also include data compression, data decomposition 
and projection, and pattern recognition. Feature extraction can also be used to enhance 
the speed and effectiveness of supervised learning. 

In one preferred embodiment of the method the data comprises data for an image to be 
displayed (the physical entity represented by the data may be considered as an image 
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stored as an electrical signal). One particular advantage of embodiments of the 
described method for this (and other) applications is the great improvement in 
processing speed which is obtainable, typically an improvement by a factor of between 
20 and 40 over conventional techniques. This makes embodiments of the method 
suitable, for example, for implementing multi-line addressing schemes when displaying 
real-time video. 

In a preferred embodiment of the method the determining of updated values comprises 
determining new values for the selected row and column substantially independent of 
previous values of the respective row and column (a row/column defining a vector with 
a plurality of elements). In general the (vector) value of a row/column is independent of 
its previous value although it is possible that the previous value of a row/column may be 
incorporated into a weighting factor (as described further later) determining a degree of 
convergence of successive iterations of the method, so appearing as a second order 
contribution. 

Preferably the determining of a target contribution comprises determining a difference 
between a target matrix X and a sum of weighted features determined by multiplying 
each other row than the selected row by each respective other column than the selected 
column of the pair of matrices. 

It will be appreciated that where a target matrix is large it may be sub-divided and the 
method applied (preferably in parallel) to each separate portion of the target matrix. For 
example a large display may be divided into four quadrants and the technique applied 
separately to each quadrant. 

Preferably the determining of updated values comprises calculating values of Gi a = f| 
(R,F) and F au = f 2 (R, G) where R is a matrix with I rows and U columns, F is a matrix 
with A rows and U columns and G is a matrix with I rows and A columns, where fi and 
f2 denote first and second functions, and where Gj a denotes a data element in the zth row 
and ath column of G and F au denotes a data element in the aih row and wth column of F. 
Preferably fi and ii are selected to minimise a cost function measuring a quality of 
approximation of a product of the selected row and column to the target contribution. 
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This cost function may comprise a squared Euclidean distance, or a divergence function, 
or some other cost function. 



In one preferred embodiment Gj a and Fj u are determined in accordance with: 

U I 

Y R. F O. YG. R. <D 

G = F = — 

Yf 2 o Yg 2 o. 

/ j au iu / j m iu 

W=l 1=1 

where R lu denotes a data element in the ith row and wth column of R, where R is given 
by: 

A a 

^iu = ^ iu ~ ^ G In F nU 

n = l 



and where O iu denotes a data element in the ith row and wth column of an I by U matrix 
<D. Where a Euclidean cost function is employed O iu is substantially unity for all i and u. 
In another embodiment <J> iu has the form <S> m = l/(Z iU + y) where Z- lu denotes a data 
element in the ith row and wth column of an I by U matrix dependent upon at least one 
of X and R, and y is positive constant less than one, preferably less than 0.1, more 
preferably less than 0.0 1 . 



In some preferred embodiments A is less than the smaller of I and U. In a display 
application A maybe equated with a "multiplex ratio", which describes a factor by 
which a number of row drive epochs may be reduced in a passive matrix display as 
compared with the number of row drive epochs required when driving each row 
separately. For example a 240 line (monochrome) screen would conventionally require 
240 separate row drive epochs but with, say, A = 36 only 36 (multiline) row drive 
epochs are required, each defining (with a set of column drive signals) a subframe 
which builds up over a frame period to produce the desired image. Thus the peak drive 
is significantly reduced and since (for an OLED display) the peak drive is closely 
related to both device efficiency and lifetime, display lifetime and/or power 
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consumption may be substantially improved. Taking into account that with multiline 
addressing techniques a sequence of subframes contribute to the overall perceived 
brightness of a pixel, the effective multiplex ratio of a displayed image may be still 
lower than the parameter A. For example a 240 line display with A = 1 20 may have an 
effective multiplex ratio of 23, resulting in a theoretical reduction in power consumption 
from approximately 100W (due largely to the high voltages required for a multiplex 
ratio of 240 combined with display capacitance) to around 2W and approximately a ten- 
fold increase in display lifetime as compared with a conventional passive-matrix drive 
scheme in which one row is driven at a time using pulse modulation. Alternatively 
benefits could be gained from allowing access to higher display luminances and/or 
larger display formats or resolutions. Furthermore trade-offs can be made between such 
specifications as resolution, size, luminance, lifetime and power consumption for a 
display to better meet the requirements of the target application. (The skilled person 
will appreciate that here the reference to "subframes" refers to one of a sequence of 
frames in time which when combined give the impression of the desired image, rather 
than to a spatial subdivision of the image, although such a spatial subdivision may 
additionally be employed). 

The method may further comprises initialising the first and second matrices, for 
example each to a substantially uniform value so that they combine to give an overall 
average value for the target matrix, in the case of a display an average brightness and/or 
colour value. However in other embodiments of the method, for example where the 
method is repeatedly applied to a sequence of slowly changing data arrays/target 
matrices, the previous values for the first and second matrices may be used as the basis 
for determining new values of these matrices. This technique may be used, for 
example, for determining matrices for displaying video data. However sometimes a 
stream of images defining a moving picture can have abrupt changes, for example from 
one scene to another and thus the initialising may be conditional upon a degree of 
difference between a current image and a previous image. This may be determined by 
determining a difference between a current and previous image or by determining a 
difference between a current image and an image approximated by a combination of the 
above mentioned first and second matrices. 



ti 

10 

Preferably the non-negativity constraint is a hard constraint, for example implemented 
by setting an updated row/column value to substantially zero where the updated value 
would otherwise be negative. The skilled person will readily appreciate the need for all 
matrix elements of the first and second matrices to be either zero or positive when these 
matrices are being used to drive an emissive display, since a "negative" emission is not 
practically implementable (the target contribution, R, may however be negative). 
Preferably the updated values are constrained by one or preferably both of a lower and 
upper limit to avoid division by small numbers adversely affecting the updating process. 

As previously mentioned, embodiments of the method converge extremely fast on the 
desired target but nonetheless generally two or more iterations of the method will be 
applied. Either a fixed number of iterations may be employed (providing a bound to the 
processing time which may be useful for some applications such as video) or the 
method may be iterated until there is substantially no change in the first and second 
matrices or until these change by less than a threshold amount, or until an error or cost 
function is less than a threshold value. As described in more detail later in 
embodiments of the method speed of convergence is controlled by a weighting factor, 
which may be adjusted as convergence proceeds and/or dependent upon one or more 
values in the target matrix (for example to provide better convergence for pixels driven 
at a low level) and/or dependent upon pixel colour (since the human eye is able to 
perceive smaller changes in green brightness than in red or blue brightness). 

Where the method is used for driving a display the display preferably comprises an 
electro-optic display more particularly an emissive display, such as an OLED display, 
especially a passive-matrix OLED display, an inorganic LED display or a plasma 
display. Thus in one preferred embodiment of the method row and column drives for a 
display are derived from values in the first and second (factor) matrices, for multi-line 
addressing. 

Embodiments of the method may be implemented in processor control code embodied 
on a carrier medium or in a computer program product, or on a computer system 
comprising data memory for storing the various matrices, program memory storing the 
processor control code, and a processor to load and implement the code, or using 
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dedicated hardware such as an ASIC (Application Specific Integrated Circuit) or FPGA 
(Field Programmable Gate Array). 

Thus the invention further provides apparatus for digitally processing data in a data 
array defining a target matrix (X) using non-negative matrix factorisation to determine a 
pair of matrices (F, G), a first matrix of said pair determining a set of features for 
representing said data, a second matrix of said pair determining weights of said features, 
such that a product of said first and second matrices approximates said target matrix, the 
apparatus comprising: means for inputting said target matrix data (X); means for 
selecting a row of said one of said first and second matrices and a column of the other of 
said first and second matrices; means for determining a target contribution (R) of said 
selected row and column to said target matrix; means for determining subject to a non- 
negativity constraint, updated values for said selected row and column from said target 
contribution; and means for repeating said selecting and determining, for the other rows 
and columns of said first and second matrices until all said rows and columns have been 
updated. 

In another aspect the invention provides a method of driving an electro-optic display, 
the display having a matrix of pixels, the method comprising: inputting image data for 
said matrix of pixels into an image data matrix; factorising said image data matrix into a 
product of first and second factor matrices; and driving said display using said factor 
matrices; and wherein said factorising comprising iteratively adjusting said factor 
matrices such that their product approaches said image data matrix; and wherein 
said iterative adjusting comprises adjusting each row of one of said factor matrices and 
each column of the other of said factor matrices in turn. 

Broadly speaking the iterative adjusting comprises adjusting a first row and column 
pair, then another and another until all the rows of one of the factor matrices and all the 
columns of the other of the factor matrices have been updated. This provides fast 
convergence (unlike the standard NMF techniques) which can be implemented without 
the need for matrix inversion operations, as compared with conventional "whole matrix 55 
approaches (for example ALS). Preferably the row/column adjusting is performed 
independently of a previous value for the row/column unlike conventional 
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multiplicative (or additive) whole matrix update rule procedures which a new value is 
determined by multiplying an old value by a factor (or by adding/subtracting to an old 
value). Driving a display in this way reduces the peak brightness of a pixel as compared 
with row-by-row driving of the display with the same data. 

The invention further provides a driver for an electro-optic display, the display having a 
matrix of pixels, the driver comprising: an input to input image data for said matrix of 
pixels into an image data matrix; a matrix factorisation system to factorise said image 
data matrix into a product of first and second factor matrices; and a driver output to 
drive said display using said factor matrices; and wherein said matrix factorisation 
system is configured to iteratively adjust said factor matrices, such that their product 
approaches said image data matrix, by adjusting each row of one of said factor matrices 
and each column of the other of said factor matrices in turn. 

In another aspect the invention provides an integrated circuit to implement the above 
described matrix factorisation system. 

In a further aspect the invention provides a method of processing a data array defining a 
target matrix (X) to determine a pair of factor matrices (F,G) such that a product of said 
factor matrices approximates said target matrix (X), the method comprising: 
determining for a single row or column of a first said factor matrix a value to which an 
updating rule would converge when iteratively applied, said updating rule comprising 
an updating rule of a factorising algorithm which iteratively updates two factor matrices 
to more closely approximate a target matrix using said updating rule; updating said row 
or column with said determined value; repeating said determining and updating for a 
column or row of a second said factor matrix; and repeating said determining and 
updating of said first and second factor matrices to update each row or column of said 
first factor matrix and each column or row of said second factor matrix. 

In embodiments the updating rule may comprise, for example, a conventional iterator 
for Euclidean or divergence minimisation NMF as described in the prior art (for 
example "Algorithms for Non-negative Factorisation", D.D. Lee and H.S. Sung, 
Advances in Neural Information Processing Systems, Vol 13, 2001) or some other 
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updating rule. Broadly speaking it will be appreciated that embodiments of this method 
provide "gain" by short circuiting the iteration procedure for a matrix element, thus 
providing faster convergence. 

Processor control code to implement the above described methods may be provided on a 
data carrier such as a disk, CD or DVD-ROM, programmed memory such as read-only 
memory (Firmware) or on a data carrier such as an optical or electrical signal carrier. 
The code may comprise code in a conventional programming language such as code for 
implementation by a digital signal processor (DSP) or code written in C, or microcode, 
or code for setting up or controlling an ASIC or FPGA, or code for a hardware 
description language such as Verilog (Trade Mark), VHDL or SystemC. As the skilled 
person will appreciate such code (and/or associated data) may be distributed between a 
plurality of coupled components in communication with one another. 

These and other aspects of the invention will now be further described, by way of 
example only, with reference to the accompanying figures in which: 

Figures la and lb show, respectively, a vertical cross section through an OLED device, 
and a simplified cross section through a passive matrix OLED display; 

Figure 2 shows conceptually a driving arrangement for a passive matrix OLED display; 

Figure 3 shows a block diagram of a known passive matrix OLED display driver; 

Figures 4a to 4e show row, column and image matrices for a conventional drive scheme 
and for a multiline addressing drive scheme respectively, corresponding brightness 
curves for a typical pixel over a frame period, and a diagrammatic representation of 
NMF factorisation of an image matrix; 

Figures 5a and 5b show a display driver embodying an aspect of the present invention, 
and example column and row drive arrangements for driving a display using the 
matrices of Figure 4e; 
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Figure 6 shows a flow diagram for a method of driving a display using image matrix 
factorisation; 

Figure 7 shows a flow diagram of an NMF procedure embodying aspects of the present 
invention; 

Figure 8 shows, diagrammatically, multiplication of a selected column and row of the G 
and F matrices of Figure 4e to determine a residual matrix; 

Figures 9a to 9f show, respectively, a starting image, iterations 1, 2 and 3, an output 
image after 10 iterations, and a second, compressed output image after 10 iterations, all 
processed for display in accordance with an embodiment of the invention; 

Figures 10a to lOd show iterations 1, 2, 3 and 10 of an image processed in accordance 
with an embodiment of the invention using Euclidean (left hand images) and 
Divergence (right hand images) cost functions; and 

Figure 1 1 shows the improvement in convergence rate for a procedure in accordance 
with an embodiment of the invention as compared with a conventional NMF procedure. 

We will describe an embodiment of the invention with specific reference to driving 
organic light emitting diode (OLED) displays using multi-line addressing (MLA) 
techniques, although as we have already indicated applications of the invention are not 
limited to this. 

Organic light emitting diode displays 

Organic light emitting diodes, which here include organometallic LEDs, may be 
fabricated using materials including polymers, small molecules and dendrimers, in a 
range of colours which depend upon the materials employed. Examples of polymer- 
based organic LEDs are described in WO 90/13148, WO 95/06400 and WO 99/48160; 
examples of dendrimer-based materials are described in WO 99/21935 and WO 
02/067343; and examples of so called small molecule based devices are described in US 
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4,539,507. A typical OLED device comprises two layers of organic material, one of 
which is a layer of light emitting material such as a light emitting polymer (LEP), 
oligomer or a light emitting low molecular weight material, and the other of which is a 
layer of a hole transporting material such as a polythiophene derivative or a polyaniline 
derivative. 

Organic LEDs may be deposited on a substrate in a matrix of pixels to form a single or 
multi-colour pixellated display. A multicoloured display may be constructed using 
groups of red, green, and blue emitting sub-pixels. So-called active matrix displays 
have a memory element, typically a storage capacitor and a transistor, associated with 
each pixel whilst passive matrix displays have no such memory element and instead are 
repetitively scanned to give the impression of a steady image. Other passive displays 
include segmented displays in which a plurality of segments share a common electrode 
and a segment may be lit up by applying a voltage to its other electrode. A simple 
• segmented display need not be scanned but in a display comprising a plurality of 
segmented regions the electrodes may be multiplexed (to reduce their number) and then 
scanned. 

Figure la shows a vertical cross section through an example of an OLED device 100. 
In an active matrix display part of the area of a pixel is occupied by associated drive 
circuitry (not shown in Figure la). The structure of the device is somewhat simplified 
for the purposes of illustration. 

The OLED 100 comprises a substrate 102, typically 0.7 mm or 1.1 mm glass but 
optionally clear plastic or some other substantially transparent material. An anode layer 
104 is deposited on the substrate, typically comprising around 150 nm thickness of ITO 
(indium tin oxide), over part of which is provided a metal contact layer. Typically the 
contact layer comprises around 500nm of aluminium, or a layer of aluminium 
sandwiched between layers of chrome, and this is sometimes referred to as anode metal. 
Glass substrates coated with ITO and contact metal are available from Corning, USA. 
The contact metal over the ITO helps provide reduced resistance pathways where the 
anode connections do not need to be transparent, in particular for external contacts to 
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the device. The contact metal is removed from the ITO where it is not wanted, in 
particular where it would otherwise obscure the display, by a standard process of 
photolithography followed by etching. 

A substantially transparent hole transport layer 106 is deposited over the anode layer, 
followed by an electroluminescent layer 108, and a cathode 110. The 
electroluminescent layer 108 may comprise, for example, a PPV (poly(p- 
phenylenevinylene)) and the hole transport layer 106, which helps match the hole 
energy levels of the anode layer 104 and electroluminescent layer 108, may comprise a 
conductive transparent polymer, for example PEDOT:PSS (polystyrene-sulphonate- 
doped polyethylene-dioxythiophene) from Bayer AG of Germany. In a typical 
polymer-based device the hole transport layer 1 06 may comprise around 200 nm of 
PEDOT; a light emitting polymer layer 108 is typically around 70 nm in thickness. 
These organic layers may be deposited by spin coating (afterwards removing material 
from unwanted areas by plasma etching or laser ablation) or by inkjet printing. In this 
latter case banks 1 1 2 may be formed on the substrate, for example using photoresist, to 
define wells into which the organic layers may be deposited. Such wells define light 
emitting areas or pixels of the display. 

Cathode layer 1 10 typically comprises a low work function metal such as calcium or 
barium (for example deposited by physical vapour deposition) covered with a thicker, 
capping layer of aluminium. Optionally an additional layer may be provided 
immediately adjacent the electroluminescent layer, such as a layer of barium fluoride, 
for improved electron energy level matching. Mutual electrical isolation of cathode 
lines may be achieved or enhanced through the use of cathode separators (not shown in 
Figure la). 

The same basic structure may also be employed for small molecule and dendrimer 
devices. Typically a number of displays are fabricated on a single substrate and at the 
end of the fabrication process the substrate is scribed, and the displays separated before 
an encapsulating can is attached to each to inhibit oxidation and moisture ingress. 
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To illuminate the OLED power is applied between the anode and cathode, represented 
in Figure la by battery 118. In the example shown in Figure la light is emitted through 
transparent anode 104 and substrate 102 and the cathode is generally reflective; such 
devices are referred to as "bottom emitters". Devices which emit through the cathode 
("top emitters") may also be constructed, for example by keeping the thickness of 
cathode layer 1 10 less than around 50-100 nm so that the cathode is substantially 
transparent. 

It will be appreciated that the foregoing description is merely illustrative of one type of 
OLED display, to assist in understanding some applications of embodiments of the 
invention. There is a variety of other types of OLED, including reverse devices where 
the cathode is on the bottom such as those produced by Novaled GmbH. Moreover 
application of embodiments of the invention are not limited to displays, OLED or 
otherwise. 

Organic LEDs may be deposited on a substrate in a matrix of pixels to form a single or 
multi-colour pixellated display. A multicoloured display may be constructed using 
groups of red, green, and blue emitting pixels. In such displays the individual elements 
are generally addressed by activating row (or column) lines to select the pixels, and 
rows (or columns) of pixels are written to, to create a display. So-called active matrix 
displays have a memory element, typically a storage capacitor and a transistor, 
associated with each pixel whilst passive matrix displays have no such memory element 
and instead are repetitively scanned, somewhat similarly to a TV picture, to give the 
impression of a steady image. 

Referring now to Figure lb, this shows a simplified cross-section through a passive 
matrix OLED display device 150, in which like elements to those of figure la are 
indicated by like reference numerals. As shown the hole transport 106 and 
electroluminescent 108 layers are subdivided into a plurality of pixels 152 at the 
intersection of mutually perpendicular anode and cathode lines defined in the anode 
metal 104 and cathode layer 110 respectively. In the figure conductive lines 154 
defined in the cathode layer 1 10 run into the page and a cross-section through one of a 
plurality of anode lines 158 running at right angles to the cathode lines is shown. An 
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electroluminescent pixel 1 52 at the intersection of a cathode and anode line may be 
addressed by applying a voltage between the relevant lines. The anode metal layer 104 
provides external contacts to the display 150 and may be used for both anode and 
cathode connections to the OLEDs (by running the cathode layer pattern over anode 
metal lead-outs). The above mentioned OLED materials, in particular the light emitting 
polymer and the cathode, are susceptible to oxidation and to moisture and the device is 
therefore encapsulated in a metal can 111, attached by UV-curable epoxy glue 1 1 3 onto 
anode metal layer 104, small glass beads within the glue preventing the metal can 
touching and shorting out the contacts. 

Referring now to Figure 2, this shows, conceptually, a driving arrangement for a passive 
matrix OLED display 150 of the type shown in Figure lb. A plurality of constant 
current generators 200 are provided, each connected to a supply line 202 and to one of a 
plurality of column lines 204, of which for clarity only one is shown. A plurality of row 
lines 206 (of which only one is shown) is also provided and each of these may be 
selectively connected to a ground line 208 by a switched connection 210. As shown, 
with a positive supply voltage on line 202, column lines 204 comprise anode 
connections 158 and row lines 206 comprise cathode connections 154, although the 
connections would be reversed if the power supply line 202 was negative and with 
respect to ground line 208. 

As illustrated pixel 212 of the display has power applied to it and is therefore 
illuminated. To create an image connection 2 1 0 for a row is maintained as each of the 
column lines is activated in turn until the complete row has been addressed, and then the 
next row is selected and the process repeated. Preferably, however, to allow individual 
pixels to remain on for longer and hence reduce overall drive level, a row is selected 
and all the columns written in parallel, that is a current driven onto each of the column 
lines simultaneously to illuminate each pixel in a row at its desired brightness. Each 
pixel in a column could be addressed in turn before the next column is addressed but 
this is not preferred because, inter alia, of the effect of column capacitance. 



19 

The skilled person will appreciate that in a passive matrix OLED display it is arbitrary 
which electrodes are labelled row electrodes and which column electrodes, and in this 
specification "row" and "column are used interchangeably. 

It is usual to provide a current-controlled rather than a voltage-controlled drive to an 
OLED because the brightness of an OLED is determined by the current flowing through 
the device, this determining the number of photons it generates. In a voltage-controlled 
configuration the brightness can vary across the area of a display and with time, 
temperature, and age, making it difficult to predict how bright a pixel will appear when 
driven by a given voltage. In a colour display the accuracy of colour representations 
may also be affected. 

The conventional method of varying pixel brightness is to vary pixel on-time using 
Pulse Width Modulation (PWM). In a conventional PWM scheme a pixel is either full 
on or completely off but the apparent brightness of a pixel varies because of integration 
within the observer's eye. An alternative method is to vary the column drive current. 

Figure 3 shows a schematic diagram 300 of a generic driver circuit for a passive matrix 
OLED display according to the prior art. The OLED display is indicated by dashed line 
302 and comprises a plurality n of row lines 304 each with a corresponding row 
electrode contact 306 and a plurality m of column lines 308 with a corresponding 
plurality of column electrode contacts 3 10. An OLED is connected between each pair 
of row and column lines with, in the illustrated arrangement, its anode connected to the 
column line. A y-driver 314 drives the column lines 308 with a constant current and an 
x-driver 316 drives the row lines 304, selectively connecting the row lines to ground. 
The y-driver 314 and x-driver 316 are typically both under the control of a processor 
318. A power supply 320 provides power to the circuitry and, in particular, to y-driver 
314. 

Some examples of OLED display drivers are described in US 6,014,1 19, US 6,201,520, 
US 6,332,661, EP 1,079,361 A and EP 1,091,339A and OLED display driver integrated 
circuits employing PWM are sold by Clare Micronix of Clare, Inc., Beverly, MA, USA. 
Some examples of improved OLED display drivers are described in the Applicant's co- 
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pending applications WO 03/079322 and WO 03/091983. In particular WO 03/079322, 
hereby incorporated by reference, describes a digitally controllable programmable 
current generator with improved compliance. 

Multi Line Addressing (MLA) techniques 

There is a continuing need for techniques which can improve the lifetime of an OLED 
display. There is a particular need for techniques which are applicable to passive matrix 
displays since these are very much cheaper to fabricate than active matrix displays. 
Reducing the drive level (and hence brightness) of an OLED can significantly enhance 
the lifetime of the device - for example halving the drive/brightness of the OLED can 
increase its lifetime by approximately a factor of four. We have previously described 
(see the Applicant's earlier patent applications, ibid) how multi-line addressing (MLA) 
techniques can be employed to reduce peak display drive levels, in particular in passive 
matrix OLED displays, and hence increase display lifetime. 

Broadly speaking MLA techniques drive two or more row electrodes at the same time 
as the column electrodes are driven (or more generally drive groups of rows and 
columns simultaneously), so that the required luminescence profile of each row (line) is 
built up over a plurality of line scan periods rather than as an impulse in a single line 
scan period. Thus the pixel drive during each line scan period can be reduced, hence 
extending the lifetime of the display and/or reducing the power consumption due to a 
reduction of drive voltage and reduced capacitive losses. This is because OLED 
lifetime reduces with the pixel drive (luminance) to a power typically between 1 and 2 
but the length of time for which a pixel must be driven to provide the same apparent 
brightness to an observer increases only substantially linearly with decreasing pixel 
drive. The degree of benefit provided by MLA depends in part upon the correlation 
between the groups of lines driven together. 

Figure 4a shows row G, column F and image X matrices for a conventional drive 
scheme in which one row is driven at a time. Figure 4b shows row, column and image 
matrices for a multiline addressing scheme. Figures 4c and 4d illustrate, for a typical 
pixel of the displayed image, the brightness of the pixel, or equivalently the drive to the 
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pixel, over a frame period, showing the reduction in peak pixel drive which is achieved 
through multiline addressing. 

Generally the row and column drive signals are selected such that a desired 
luminescence of OLED pixels (or sub-pixels) driven by the corresponding electrodes is 
obtained by a substantially linear sum of luminescences determined by the drive signals. 
We have previously described (ibid) a controllable current divider to divide column 
current drive signals between two or more rows in accordance with the determined row 
drive signals. 

To determine the required drive signals image data for display may be considered as a 
matrix and factorised into a product of two factor matrices, one defining row drive 
signals, the other column drive signals. The display is driven with successive sets of 
row and column signals, as defined by these matrices, to build up a displayed image, 
each set of signals defining a subframe of the displayed image the same size as the 
originally factorised matrix. The total number of line scan periods (subframes) may but 
need not necessarily be reduced compared with a conventional line-by-line scan 
(reduction implying image compression), since some benefit is obtained merely by 
averaging out the brightness over a number of subframes. 

NMF data processing 

Preferably the image matrix factorisation comprises non-negative matrix factorisation 
(NMF). Broadly speaking in NMF the image matrix X (which is non-negative) is 
factorised into a pair of matrices F and G such that X is approximately equal to the 
product of F and G, F and G being chosen subject to the constraint that their elements 
are all equal to or greater than zero. A typical NMF algorithm iteratively updates F and 
G to improve the approximation by aiming to minimise a cost function such as the 
squared Eucliden distance between X and FG. Non-negative matrix factorisation is 
useful for driving an electroluminescent display as such a display cannot be driven to 
produce a "negative" luminescence. 
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A NMF factorisation procedure is diagrammatically illustrated in Figure 4e. The 
matrices F and G can be regarded as defining a basis for the linear approximation of the 
image data and in many cases a good representation of can be achieved with a relatively 
small number of basis vectors since images generally contain some inherent, correlated 
structure rather than purely random data. The colour sub-pixels of a colour display may 
be treated as three separate image planes or together as a single plane. Sorting the data 
in the factor matrices so that bright areas of a displayed image are generally illuminated 
in a single direction, from top to bottom of the display, can reduce flicker. 

Background information relating to NMF techniques can be found in the following 
references: D. D. Lee, H. S. Seung. Algorithms for non-negative matrix factorization; 
P. Paatero, U. Tapper. Least squares formulation of robust non-negative factor analysis. 
Chemometr. Intell. Lab. 37 (1997), 23-35; P. Paatero. A weighted non-negative least 
squares algorithm for three-way TARAFAC factor analysis. Chemometr. Intell. Lab. 
38 (1997), 223-242; P. Paatero, P. K. Hopke, etc. Understanding and controlling 
rotations in factor analytic models. Chemometr. Intell. Lab. 60 (2002), 253-264; J. W. 
Demmel. Applied numerical linear algebra. Society for Industrial and Applied 
Mathematics, Philadelphia. 1997; S. Juntto, P. Paatero. Analysis of daily precipitation 
data by positive matrix factorization. Environmetrics, 5 (1994), 127-144; P. Paatero, U. 
Tapper. Positive matrix factorization: a non-negative factor model with optimal 
utilization of error estimates of data values. Environmetrics, 5 (1994), 1 1 1-126; C. L. 
Lawson, R. J. Hanson. Solving least squares problems. Prentice-Hall, Englewood Cliffs, 
NJ, 1974; Algorithms for Non-negative Matrix Factorization, Daniel D. Lee, H. 
Sebastian Seung, pages 556-562, Advances in Neural Information Processing Systems 
13, Papers from Neural Information Processing Systems (NIPS) 2000, Denver, CO, 
USA. MIT Press 2001; and Existing and New Algorithms for Non-negative Matrix 
Factorization By Wenguo Liu & Jianliang Yi ( www.dcfl, gov/DCCI/rdwg/nmf.pdf ; 
source code for the algorithms discussed therein can be found at 
http://www.cs.utexas.edu/users/liuwg/383CProject/CS_383C_Project.htm). 



Figure 5a shows a schematic diagram of an embodiment of a passive matrix OLED 
driver 500 which implements an MLA addressing. 
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In figure 5a a passive matrix OLED display similar to that described with reference to 
figure 3 has row electrodes 306 driven by row driver circuits 512 and column electrodes 
310 driven by column drives 510. Details of these row and column drivers are shown in 
figure 5b. Column drivers 510 have a column data input 509 for setting the current 
drive to one or more of the column electrodes; similarly row drivers 512 have a row 
data input 5 1 1 for setting the current drive ratio to two or more of the rows. Preferably 
inputs 509 and 51 1 are digital inputs for ease of interfacing; preferably column data 
input 509 sets the current drives for all the U columns of display 302. 

Data for display is provided on a data and control bus 502, which may be either serial or 
parallel. Bus 502 provides an input to a frame store memory 503 which stores 
luminance data for each pixel of the display or, in a colour display, luminance 
information for each sub-pixel (which may be encoded as separate RGB colour signals 
or as luminance and chrominance signals or in some other way). The data stored in 
frame memory 503 determines a desired apparent brightness for each pixel (or sub- 
pixel) for the display, and this information may be read out by means of a second, read 
bus 505 by a display drive processor 506 (in embodiments bus 505 may be omitted and 
bus 502 used instead). 

Display drive processor 506 may be implemented entirely in hardware, or in software 
using, say, a digital signal processing core, or in a combination of the two, for example, 
employing dedicated hardware to accelerate matrix operations. Generally, however, 
display drive processor 506 will be at least partially implemented by means of stored 
program code or micro code stored in a program memory 507, operating under control 
of a clock 508 and in conjunction with working memory 504. For example the display 
drive processor may be implemented using a standard digital signal processor and code 
written in a conventional programming language. The code in program memory 507 is 
configured to implement an embodiment of a multi-line addressing method as described 
further below, and may be provided on a data carrier or removable storage 507a. 

Figure 5b illustrates row and column drivers suitable for driving a display with a 
factorised image matrix. The column drivers 1000 comprise a set of adjustable 
substantially constant current sources 1002 which are ganged together and provided 
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with a variable reference current I re f for setting the current into each of the column 
electrodes. This reference current is pulse width modulated by a different value for 
each column derived from a row of a factor matrix such as row a of matrix F of Figure 
4e. The row drive 1010 comprises a programmable current mirror 1012, preferably 
with one output for each row of the display or for each row of a block of simultaneously 
driven rows. The row drive signals are derived from a column of a factor matrix such as 
column a of matrix G of Figure 4e. Further details of suitable drivers can be found in 
the Applicant's co-pending UK patent application no. 042171 1.3 filed on 30 September 
2004, and in the PCT application GB2005/050168 filed 29 Sept 2005 claiming priority 
therefrom, both hereby incorporated by reference. In other arrangements other means of 
varying the drive to an OLED pixel, in particular PWM, may additionally or 
alternatively employed. 



Figure 6 shows a flow diagram of an example procedure for displaying an image using 
NMF, and which may be implemented in program code stored in program memory 507 
of display drive processor 506 of Figure 5a. 



In Figure 6 the procedure first reads the frame image matrix X (step S600), and then 
factorises this image matrix into factor matrices F and G using NMF (step S602). This 
factorisation may be computed during display of an earlier frame. The procedure then 
drives the display with A subframes at step 604. Step 606 shows the subframe drive 
procedure. 



The subframe procedure sets G-column a -> R to form a row vector R. This is 

automatically normalised to unity by the row driver arrangement of Figure 5b and a 
scale factor x, R <— xR is therefore derived by normalising R such that the sum of 
elements is unity. Similarly with F, row a -» C to form a column vector C. This is 

scaled such that the maximum element value is 1 , giving a scale factor y, C <- yC . The 

A I .f 

a frame scale factor / = — is determined and the reference current set by I ref = 

I xy 

where Io corresponds to the current required for full brightness in a conventionally 
scanned line-at-a-time system, the x and y factors compensating for scaling effects 
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introduced by the driving arrangement (with other driving arrangements one or both of 
these may be omitted). 

Following this, at step S608, the display drivers shown in Figure 5b drive the columns 
of the display with C and rows of the display with R for MA of the total frame period. 
This is repeated for each subframe and the subframe data for the next frame is then 
output. 

Fast NMF data processing 

Embodiments of NMF data processing procedures for MLA and other applications, 
according to the present invention, will now be described in more detail. 

Referring to figure 4e and to figure 7, an NMF procedure embodying aspects of the 
present invention begins by initialising F and G (step S700) so that the product of G 
and F is equal to the average value of X, Xaverage, as follows: 



For a sequence of related images previously found values of F and G may be used. The 
subscripts indicate number of rows and columns respectively; lower case subscripts 
indicate a single selected row or column (eg a for one of A rows); 1 is the unity matrix. 

Preferably, as a pre-processing step (not shown) prior to step S700, blank rows and 
columns are filtered out. 

The overall aim of the procedure is to determine values for F and G such that: 



G - Iia F - (X av erage/A).lAU 



(i) 



G IA F AU = X 



IU 



(2) 



The procedure we describe operates with a single column (a) of G and a single row (a) 
of F at a time, stepping through all the column-row pairs, from a = 1 to a = A (step 
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S702). Thus the procedure, for each column of G and row of F, first calculates a 
residual Rnj a for the selected column-row pair, this residual comprising a difference 
between the target Xiu and a sum of the combined contributions of all the other columns 
and rows of G and F except for the selected column/row (step S704): 



For each selected column-row pair a of G and F the aim is for the contribution of the 
selected column-row pair to equal the residual Rru a , as illustrated diagrammatically in 
Figure 8. In mathematical terms the aim is: 



where R a lv defines an IxU image subframe with mux rate A (A subframes contributing to 
a complete IxU displayed image). 

Equation (4) can be solved for each of the / elements Gj a of the selected column a of G 
and for each of the U elements F au of the selected row a of F (step S706). The solution 
depends upon the cost function. For example, performing a least squares fit (a 
Euclidean cost function) on (4) multiplies the left hand side by F aU .F T a u (which is a 
scalar value, so that no matrix inversion is required to divide both sides by this) and 
multiplies the right hand side by F aU , allowing Gj a to be calculated directly. This is 
described in more detail later. 

Some example solutions are as follows. 



A,n*a 




(3) 



G Ia F aU = R 



a 



IU 



(4) 



For a Euclidean cost function, which aims to minimise the following expression, where 
A and B are non-negative matrices X and G.F: 
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A - B|| ! = I(A, - B„)' 



iu au 



2 



/ j ia iu 



F = 



— 1=1 



2 



£=1 



For a "divergence" cost function (Lee and Seung, ibid) which aims to minimise the 
following (the log is to base e): 



D(A|| B)=X(A ( ,bg-^--A, /+ B, / ) 



^ R, F. 



G = 

ia 



14=1 



iu au 



^ G,R 



e 

IU 



U J7 2 V ? 

\ 1 au iu 



F = 



I 

1=1 



0 



au 



^G 2 X. 

ia iu 



«=1 



0 



2. 

j=l 



0 



IU 



where 



0 = X, - R 



iu iu 



iu . For a generalised method: 



U 



G_ M=l 



Yr f o. Yg. r. o 

/ j i u au iu / j ia iu 

F - i=L 

> ± au I 



iu 



Yf 2 <d 

/ i au 



iu 



Yg 2 o> 

/ j ia 



iu 



1=1 
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where 0 /tt is a parameter (of the IxU matrix O), which may be a constant or which may 

depend upon one or more of & iu ,X iu and R iu , and which controls speed of 
convergence (further details are given later). 

To provide a non-negativity constraint, values of Gj a and F au which are less than zero 
are set to zero (or a small value), at step S708 (elements of Riu a are permitted to be 
negative). 

Preferably (but not essentially), to prevent division by zero (or infinite) values of Gi a 
and F au may be limited by upper and/or lower bounds of, for example, 0.01 or 0.001 and 
10 or 100; these may be varied according to the application (step S710). 

Optionally but preferably the procedure then iterates (step S712), for example for a 
predetermined number of iterations. 

As described in more detail later, because the human eye is more sensitive to small 
brightness differences at low brightness levels than at high brightness levels a Euclidean 
cost function is not necessarily optimal, and RMS (root mean square) error in the final 
image is not necessarily the best figure of merit (although convenient). 

It will be appreciated that the above procedure does not employ a conventional 
multiplicative update rule, where F and G are each multiplied by a factor to bring them 
closer to a stationary point of a cost function. Instead new values are jointly determined 
for single column/row pairs of F and G selected in turn, the new values of the elements 
Gi a and F au being calculated without reference to their previous values - in equations 
(5)-(7) above the calculation is a new value for, say Gj a depends upon F and R a but it 
can be seen from equation (3) that R a is not dependent upon column Gi a . 

The inventor has recognised that there is a general method for deriving a fast- 
converging pairwise-update NMF procedure from any conventional whole matrix 
procedure. Broadly speaking the whole matrix procedure is applied to determine what 
values the procedure would converge to for a single column/row, and this calculation is 
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then used to determine an algebraic expression for these convergence values. This 
algebraic expression is then used for a pairwise column and row update of the factor 
matrices, selected pair by selected pair. This will be illustrated for the examples of 
Euclidean and Divergence cost functions but can also be applied to other whole matrix 
NMF procedures to generate new fast-converging procedures. We then describe an 
alternative derivation and a generalisation of these illustrative examples. 



Using a standard iterator for Euclidean minimisation NMF (only one iterator shown; the 
results applicable to the other iterator by symmetry), expressed for an iteration 
performed on one subframe only, a lowercase index indicating a single element (row or 
column) and an uppercase index indicating the operation on the whole range: 



Y F T 

G' = G IU aU 



la w la 



G F F T (8) 

^IA 1 AU 1 aU 



Substituting in the following: 



B I - X IU F aU (9) 



and 



Ca ~ F AU F aU (10) 



into (8) gives: 



r' -r 1 
Ia Ia G C 



IA^A 



Which can be expanded to give: 
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G =G. 

la it 



A,n*a 



G C + YG. C 

ia a / j in , 



(12) 



n 



Consider the case where this expression is not applied once per iteration, but multiple 
times until G ia reaches equilibrium. Equilibrium can be reached in one of two ways: a) 
G ia tends to zero or b) the ratio tends to unity. For the ratio to equal unity: 



It can be seen that the expression (12) can never result in a negative G element when all 
terms in G, F and X are positive, however expression (13) can return a negative value, 
and it is the case where (13) returns a negative when repeated application of (12) would 
result in G ia tending to zero. Therefore in this case G ia is set to zero, or to some 
minimal value. It should also be noted that if C a is very small, or zero, then a 
distortingly large value may result - in this case a reasonable maximum limit to G, a may 
be applied. 

Equation (13), with a similar iterator for F, can be used as an alternative Euclidean 
minimisation iterator, stepping through the two matrices one a index at a time. 

Figure 9 shows (in a format corresponding to figure 4e) the result of 10 iterations of the 
above procedure. Figures 9a to 9e show, respectively, the starting image, iterations 1 , 2 
and 3 and the output image after 10 iterations. 



A,n*a 






(13) 



The image is monochrome, 126 pixels wide by 100 pixels high and the procedure was 
initialised with uniform F and G (Figure 9b); a centroid sorting was applied to columns 
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of G and to the rows of F for the final image; 100 subframes were used (A = 100). The 
results are characterised as follows: 

Image row count (original MUX) 100 



Estimated life expectancy gain* 3.084628 
*note: assumes a quadratic dependency of life expectancy on drive level 

A second run with half the rows (A = 50) gave the result shown in Figure 9f. The 
iterator was adapted with a minimum result of 0.001 and a maximum of 10, with each 
column of the row matrix being re-normalised to a maximum of 1 after each iteration of 
a complete frame. The results of this run are characterised as follows: 

Image row count (original MUX) 100 



Estimated life expectancy gain* 5.030235 
*note: assumes a quadratic dependency of life expectancy on drive level 

Using a standard iterator for Divergence minimisation NMF (only one iterator shown; 
the results applicable to the other iterator by symmetry), expressed for an iteration 
performed on one subframe only, a lowercase index indicating a single element (row or 
column) and an uppercase index indicating the operation on the whole range: 



Raw MLA MUX 
Effective MLA MUX 



100 

32.418824 



Raw MLA MUX 
Effective MLA MUX 



50 

19.879786 





u 




(14) 



u 



Expanding and separating out the G lfl term within the ratio: 
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G =G 

ia ia 
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A,n* a 

X G in F nu + G ia F au 
n=l 



/ j au 



u 



Re-arranging: 



s 



u 



G =G n 

ia ia 



F X 

au iu 



( 



A 9 n*a 



X G in F nu 



C F 

j _|_ ia au 



A,n* a 

Yg.f 

/ j in nu 
V n=\ J 



/ 4 au 



u 



And substituting in: 



C. = 



F 



au 



u A,n*a 

Yg.f 

/ j in r 



nu 



into (16) gives: 
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z 



g: = g. 



cx 

M IK 

1 + G. C 

ia u 



la ia 



u 



If we can assume ^ia^u ^ then (by a Taylor series expansion): 



(18) 



1 



1 + G C 

ia u 



(19) 



Substituting (19) into (18) gives: 



Which expands to: 



u 



Yf 

/ j au 



u 



Yc x. -g Yc 2 x. 

/ j u iu ia / j u iu 



G =G 
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u 



Yf 



u 



(20) 



(21) 



Taking the principal of repeated application of the above iterator, as described above 
with reference to the Euclidean minimisation iterator, the same conclusion can be 
drawn, that is the value of G ia will reach a stable value either as it approaches zero or as 
the ratio approaches 1 . 



For the ratio to approach unity: 



34 



G. = - JL - 



ZC 2 X. (22) 
U lU 



u 



u iu — au then Gia will tend to zero. 

u u 



In practice it is preferred to limit all values of G (and, by summetry, F) to within two 
limits, for example 0.001< G , F <1000 seems to provide a good solution. 



Figures 10a to lOd show iterations 1, 2, 3 and 10 of a 100x100 pixel monochrome 
image processed in accordance with the above described techniques using Euclidean 
(left hand images) and Divergence (right hand images) cost functions. The results after 
20 iterations for full subframe solution are: 





Fast Euclidean NMF 


Fast Divergence NMF 


Worst case MUX 


28.8 


14.7 


Average MUX 


14 


8 


Average MLA level 


13.5 lines 


19.4 lines 


Average lifetime gain 


x5.4 


xlO 



The general conclusions are that fast divergence NMF produces a more recognisable 
image faster than fast Euclidean NMF, but with a larger RMS luminance error; and that 
fast divergence NMF produces (much) more distributed solutions - i.e. the average 
effective MUX rate is lower, sometimes by a factor of 2. 



We next describe a generalised fast NMF technique that can be applied in embodiments 
of the present invention. 



The target is to determine values for G and F such that: 
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GtaFatt — X 



IA l AU " ^IU (23) 



Expressing this as a sum of terms: 



a=\ 



where, as before, a lower case index denotes a single element, an upper case index the 
complete range so that, for example Gi a represents a single sub-frame row signal vector. 
We are interested in obtaining the best fit for a single sub-frame: 



A n* a 



W (25) 



This can now be solved, for either G or F, using a least-squares fit procedure. The 
derivation of such a least squares fit is as follows: 



Aa =b 
A T Aa = A T b 

(26) 

a = (A T Ay 1 A T b 



where a is a vector containing the n unknown constants, A is an m x n matrix of the 
known parameters and b is a vector containing the m known results (compare, for 
example, to the more familiar notation y = Xa where each value of y is associated with 
values of xj, X2 solving for a). If n>m (i.e. if there are more unknowns than results) 
then A 7 A is singular and non-invertable. 



Here the procedure of (26) is applied directly to (25), multiplying by F* v to solve for a 
single value of G (ie. Gj a ): 



t 
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A,n* a 

T 



Gi a F aU F aU — X iV F aU £jGi n F nU F aU 



n=\ 

A,n* a 

X F T - V G F F T 

/~< n=l 

" F F T 

r aU F aU 
U f A,n*a \ 

Y X. F -YG.FF 

/ i iu au / i in nu au 

ri u=\ V n=l J 

Kj — — 

ia U 

2 



(27) 



7f 

u=\ 



Which is possible as F a v is a vector, therefore F a v F T a v is a single, scalar value and so 
no matrix inversion is required. This is precisely the fast iterator derived from the 
original Euclidean minimisation NMF. Applying (26) to (25) to solve for F produces a 
similar result. 



The result can, if desired, be expressed more simply by introducing R w which is the 
residual luminance unsolved by the other sub-frames, that is: 



A a 

R IU = X IU - X G In F n 



U 



n = l 



(28) 



So (27), and the iterator for F, becomes: 



U 



Yr.f Ygr 

/ j iu au / j ia iu 

G_ U = l 77 _ i=l 

in ~ Tl > 



ia U 5 au I 

y F i y G 2 (in 

/ ^ au / j ia 

u=l 1=1 
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Re-expressing the fast divergence iterator in a similar way: 




A,n*a 



e,, = I 



C F 

in nu 



n=l 



X — R 

iu iu 



(31) 



This re-expression suggests other options, and how to resolve some of the short- 
comings of the above techniques, in particular that the Euclidean minimisation, as it is 
concerned with minimising absolute differences, tends to produce noise in the black 
levels and that the divergence minimisation can get easily stuck. 

Examination of (29) and (30) leads to a number of observations. First the divergence 
minimisation weights the sums by a factor approximately inversely proportional to the 
pixel luminance at that location. This seems to more successfully preserve black levels 
correctly, however the sums in the ratio are not balanced, that is the terms in the 
nominator and denominator are not the same. This may explain why the method can get 
quite quickly to a partial solution, but then sometimes does not then progress to a good 
final solution. This suggests that a good iterator needs to be balanced, however 
weighting to improve black levels would be advantageous. 



Broadly speaking the methods we describe have the general form: 
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iu 
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/ j ia iu 



iu 



G = 

ia 



_ «=1 



U 



F = 

' 1 au 



j'=l 



Yf 2 <3> 

/ j au 



iu 



(32) 



IU 



i=\ 



For example if O iu =1 then (32) becomes the fast Euclidean iterator. Other preferred 
possibilities include O. II =1/(0. U +^) 5 <3> iu =l/(X iu +y) and O itf =l/(^. M +y) where y is 

a small value to prevent divisions by zero (e.g. y =0.001). All of these converge 

quickly producing RMS luminance errors close to (29) but with much lower divergence 
(to not converge with divergence as quickly as (30) initially, but catch-up and overtake 
once it gets stuck) and, significantly, much lower RMS grey-level error and superior 
preservation of black levels and (therefore) colour saturation (in a colour display). 

Consider, for example, < I ) /U = 1/(® (W at the start of the procedure X and R are 
different so that <i> iu is of order unity, but as the procedure progresses and R gets 
smaller and O fH approaches l/(X itt ) so that the weight automatically changes to 

provide improved convergence as the procedure progresses. Optionally the weight <D /U 

may also include a colour-dependent term (weighting function), for example to provide 
better convergence for one colour (say green) than another (say red or blue). This can 
help match the performance of the procedure, for example measured by RMS error or 
some other figure of merit, to the characteristics of the human eye. A similar technique 
can be employed to reduce the noise in greyscale space, by giving additional weight to 
low luminance components, to which the human eye is disproportionately more 
sensitive. 



It is also possible to re-express the above equations in a simplified form, which 
facilitates their practical application. In the re-expression below we adopt an alternative 
nomenclature, in which the input image is given by matrix V with elements V xy and in 
which R denotes a current row matrix, C a current column matrix, Q a remaining error 
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between V and R.C, p the number of sub-frames, average an average value, and gamma 
an optional gamma correction function. 



The variables are initialised as follows: 

av - average(gamma(V iy ) 

initial RC = yj(av/ p) 
^gammaCV^-av 



An embodiment of the NMF system then performs the following calculation for/? =1 to 
the total number of subframes: 



start 

Qxy = Qry + R py C ,p f° r eClch X afld V 

R nv = ^ for each y 

py bias + YCC 



bias + SQ»y R py 
C„ = 4^ far each x 

z.^ py py 



Qiy = Qxy ~ R py C xp M mch X Und V 



loop to start 



The variable bias prevents division by zero, and the values of R and C pull towards this 
value. A value for bias may be determined by initialRC x weight x no. of. columns 
where the number of columns is x and the weight is, for example, between 64 and 128. 



The above described techniques are applicable to both organic and inorganic LED- 
based displays. The addressing schemes described have pulse width modulated column 
drive (time control) on one axis and current division ratio (current control) on the other 
axis. For inorganic LEDs voltage is proportional to logarithm current (so a product of 
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voltages is given by a sum of the log currents), however for OLEDs there is a quadratic 
current- voltage dependence. In consequence when the above described techniques are 
used to drive OLEDs it is important that PWM is employed. This is because even with 
current control there is a characteristic which defines the voltage across a pixel required 
for a given current and with only current control the correct voltage for each pixel of a 
subframe cannot necessarily be applied. The schemes described nonetheless work 
correctly with OLEDs because rows are driven to achieve the desired current and 
columns are driven with a PWM time, in effect decoupling the column and row drives, 
and hence decoupling the voltage and current variables by providing two separate 
control variables. 

Some further optimizations are as follows: 

Because current is shared between rows, if the current in one row increases the current 
in the rest reduces, so preferably (although this is not essential) the reference current 
and sub-frame time are scaled to compensate. For example, the sub-frame times can be 
adjusted with the aim of having the peak pixel brightness in each subframe equal (also 
reducing worst-case/peak-brightness aging). In practice this is limited by the shortest 
selectable sub-frame time and also by the maximum column drive current, but since the 
adjustment is only a second order optimisation this is not a problem. 

Later sub-frames apply progressively smaller corrections and hence they tend to be 
overall dimmer whereas the earlier sub-frames tend to be brighter. With PWM drive, 
rather than always have the start of the PWM cycle an "on" portion of the cycle, the 
peak current can be reduced by randomly dithering the start of the PWM cycle. In a 
straightforward practical implementation a similar benefit can be achieved with less 
complexity by, where the off-time is greater than 50%, starting the "on" portion timing 
for half the PWM cycles at the end of the available period. This is potentially able to 
reduce the peak row drive current by 50%. 

With rows comprising red (R), green (G) and blue (B) (sub-)pixels (i.e. an RGB, RGB, 
RGB row pattern), because each (sub-)pixel has different characteristics a given voltage 
applied to a row may not achieve the exact desired drive currents for each differently 
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coloured OLED (sub-)pixel. It is therefore preferable, in embodiments, to use an OLED 
display with separately drivable rows of red, green and blue (sub-)pixels (i.e. groups of 
three rows with respective RRRR. . ., GGGG. . . and BBBB. . . patterns); this type of 
display configuration can also provide manufacturing advantages. 

Embodiments of the invention have been described with specific reference to OLED- 
based displays. However the techniques described herein are also applicable to other 
types of display including, but not limited to, vacuum fluorescent displays (VFDs) and 
plasma display panels (PDPs) and other types of electroluminescent display such as 
thick and thin (TFEL) film electroluminescent displays, for example iFire (RTM) 
displays, large scale inorganic displays and passive matrix driven displays in general. 

The skilled person will recognise that, as previously described, embodiments of the 
above described methods may be implemented on a dedicated integrated circuit, or by 
means of a gate array, or in software on a DSP (digital signal processor), or in some 
combination of these. 

The improvement in convergence rate for procedures as described above as compared 
with a conventional NMF procedure is shown in Figure 1 1 . It can be seen that the 
techniques described herein converge, for this example more than an order of magnitude 
faster than a conventional procedure. It can also be seen from the examples that the 
techniques described herein begin to converge faster than conventional techniques. 

Embodiments of the above described techniques provide image data processing which 
converges with a full frame MLA solution in only 5-20 steps, producing solutions with 
as great, or greater, MUX gains, and which furthermore can cope better with text and 
icon image content than conventional procedures where the number of required 
iterations can reach 1000. 

The speed is, in embodiments, sufficient that real-time video applications can be 
envisaged. Combining this with a capability to dramatically reduce MUX rate makes 
possible Passive Matrix TV-sized screens (say 8" and above) with only slightly higher 
power consumption, and vastly lower cost, than active matrix equivalents. As an 
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example, a 32" diagonal VGA screen may be driven as an MLA passive matrix with 
only 50% more power consumption than the active matrix equivalent. 

No doubt many effective alternatives will occur to the skilled person. For example the 
image manipulation calculations described above are not dissimilar in their general 
character to operations performed by consumer electronic imaging devices such as 
digital cameras and embodiments of the method may be conveniently implemented in 
such devices. 

It will be understood that the invention is not limited to the described embodiments and 
encompasses modifications apparent to those skilled in the art lying within the spirit and 
scope of the claims appended hereto. 



